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THE RESEARCH & EVALUATION 
MONITORING SYSTEM 


Introduction 


1.01 Over the last few years the Canada Council has designed, developed and 
implemented a research and evaluation monitoring system (REMS). For purposes of 
REMS, research refers to the search for information in the face of ignorance, 
e.g. what is the income status of artists? Evaluation refers to the assessment of 
available information, e.g. given the fact that self-employed artists are second to 
pensioners as the lowest paid occupation group recognized by National Revenue, 
what are the implications for Canada Council programs and how ean this 
information be best used to increase public and private support to the arts? 


1.02 The objectives of REMS are: (i) to accumulate statistical and descriptive 
evidence concerning trends in Canada Council support to the arts; and (ii) to 
support Council's accountability, budgeting, evaluation, planning and research 
activities. In addition to an arts research bibliography, REMS is made up of four 
data sets covering the period 1970 to 1987 (Chart 1, page 2). 


REMS DATA SETS 
Grants & Services 


2.01 This data set includes descriptive evidence concerning the objectives and 
evolution of Canada Council policies, programs, procedures and performance as 
well as statistical trend data bases concerning grants and services measured by: 
their number, distribution, current and constant dollar value, annual rates of 
change and average annual growth rates by discipline, responsibility centre, 
program type, province of residence, sex, citizenship and language of award 
winners. 


Administration 


2.02 This data set includes evidence concerning the financial, personnel and 
resource costs associated with Canada Council grants and services. Evidence is 
collected through a specially designed system of standard objects of expenditure 
appropriate for Council's grant-giving and service activities. The data set also 
includes the Canada Council Arts Inflation Index used for the inflationary 
adjustment of Council's parliamentary grant during the Federal Policy & 
Expenditure Management System Autumn Up-Date. 


Clients 


2.03 This data set includes evidence concerning artists, audiences and arts 
organizations. Evidence is collected through trend data bases reporting the socio- 
demographic characteristics, financial and other activities of Canada Council 
clients as well as inventories of selected client activities, e.g. projects, exhibitions 
and productions. 


Socio-Economic Environment 


2.04 This data set includes evidence concerning philanthropic, profit and public 
sectors at the community, regional, national and international levels, as they 
affect artists, audiences and arts organizations. Evidence is collected through 
trend data bases reporting financial and other support to the arts provided by the 
philanthropic, private and public sectors. 
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THE RESEARCH & EVALUATION 
MONITORING SYSTEM 
(cont'd) 


REMS APPLICATIONS 


3.01 There are three major applications of REMS. The first concerns the Federal 
Policy & Expenditure Management System (PEMS), more commonly known as the 
"envelope system". The second concerns special studies conducted by the Canada 
Council and other arts organizations. The third application concerns the day-to- 
day administration of the Canada Council. 


Federal Policy & Expenditure Management System 


3.02 First, REMS provides Canada Council with factual evidence required to 
support its request for an annual appropriation from the federal Parliament. Under 
PEMS Canada Council's request must include a five year Strategic Overview, an 
Operational Plan, an Inflationary Adjustment Statement and a Program Evaluation 
Plan. 


Special Studies 


3.03 Second, REMS provides baseline information required for in-depth program 
evaluations and research studies. As noted by Treasury Board, the most expensive 
and time-consuming part of most program evaluations is accumulation of relevant 
information. REMS provides a wide range of basic information in support to 
program evaluations and research studies and thereby significantly reduces the cost 
and increases the timeliness of such studies. 


3.04 An example of REMS' results in support of program evaluation is the research 
program for the National Theatre School inquiry conducted by Dr. Davidson 
Dunton. Five research documents were provided to Dr. Dunton which established 
the factual situation of the school. With these facts, Dr. Dunton was able to assess 
opinions concerning the operations and success of the School as expressed by 
artists, arts administrators, unions and professional associations. 


Administration 


3.05 Third, REMS' results are used in the day-to-day administration of the Canada 
Council. Currently three grant-giving programs, Explorations, Killam and Video, 
use detailed REMS' inventories of grants. Inventories allow program managers to 
readily assess new requests in the context of all projects previously supported. 
Inventories generally provide detailed information by discipline and sub-discipline 
geo-coded by province and municipality. 


3.06 The Canada Council also uses financial information generated by the REMS 
system of Standard Objects of Expenditure in its budgetary cycle. Standard 
Objects of Expenditure facilitate analysis and comparison among administrative 
and arts sections over time. In addition Standard Objects of Expenditure are used 
to calculate the Canada Council Arts Inflation Index. Arts Inflation Index has been 
aecepted by Treasury Board as the most reasonable estimate of the impact of 
inflation on the operations of the Canada Council. Arts Inflation Index is, in turn, 
used to estimate the inflationary adjustment to Council's annual parliamentary 
appropriation. 


THE RESEARCH & EVALUATION 
MONITORING SYSTEM 
(cont'd) 


PROPOSED FUTURE DEVELOPMENTS 


4.01 Current and future Canada Council research and evaluation activities are 
based upon the unique mandate of the Council and upon the fact that federal 
cultural research and statistics activities, conducted by the Department of 
Communications and Statistics Canada, capture between 90 to 95% of Canadian 
cultural activity. For statistical purposes of the federal government this result is 
generally more than adequate. 


4.02 For purposes of the Canada Council, however, the remaining 5 to 10% of 
activity is critical. Specifically, activity not currently monitored by the federal 
cultural statistics program tends to involve artistic as opposed to commercial 
activity. While small in economic terms, the arts can be considered the R&D 
component of the arts industries and are essential to the eventual development of 
new and commercially viable cultural product. 


4.03 The Canada Council, through its grant-giving process, is the logical and most 
effective focus through which necessary statistical evidence concerning the arts 
ean be obtained. The ability of the Canada Council to conduct necessary research 
and statistical activities is, however, severely limited by the low level of funding 
currently available to Council. 


4.04 Resources permitting, REMS will be extended during the next five years to 
include trend data bases and inventories concerning clients not currently covered. 
Proposed new trend data bases and inventories include: (i) a Literary Arts Data 
Base covering book and periodical publishers which are Council clients; (ii) a Media 
Arts Data Base covering film and video production, distribution and exhibition co- 
operatives which are Council clients, and, (iii) a Canadian Play Inventory of the 
performance history of Canadian plays. 


Conelusions 


5.01 REMS has proven a cost-effective, timely and useful information base to 
support Canada Council's accountability, budgeting, evaluation, planning and 
research activities under the new federal Policy & Expenditure Management 
System. It has enhanced Canada Council's credibility with Treasury Board and 
other federal departments and agencies and has highlighted the economic problems 
and importance of the arts in Canada. 


5.02 REMS' results are used by Canada Council program managers in the operation 
of their grant-giving and service activities and by Council management in the 
budgetary cycle. REMS results have also been provided to arts organizations and 
clients as well as provincial and foreign grant-giving agencies in support of their 
own accountability, budgeting, evaluation, planning and research activities. 
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